Universality under conditions of self-tuning 



Ole Peters 1 '^] and Michelle Girvan 2 - 5 !!] 

1 Department of Mathematics and Grantham Institute for Climate Change, 

Imperial College London, 180 Queen's Gates, London SW7 2 AZ, UK 
2 Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM, 87501, USA 
3 University of Maryland, IREAP, Bldg 223, Paint Branch Dr., College Park, MN 20742 

We study systems with a continuous phase transition that tune their parameters to maximize 
a quantity that diverges solely at a unique critical point. Varying the size of these systems with 
dynamically adjusting parameters, the same finite-size scaling is observed as in systems where all 
relevant parameters are fixed at their critical values. This scheme is studied using a self-tuning 
variant of the Ising model. It is contrasted with a scheme where systems approach criticality 
through a target value for the order parameter that vanishes with increasing system size. In the 
former scheme, the universal exponents are observed in naive finite-size scaling studies, whereas in 
the latter they are not. 



One historical motivation for the study of critical phe- 
nomena are the observable effects of diverging correla- 
tion lengths, such as critical opalescence [I]. On a more 
fundamental level, universality, the fact that a variety 
of phenomenologically different systems share the exact 
same critical behavior, reveals a deeply engrained math- 
ematical structure in physical systems. 

Universality is well understood in equilibrium systems 
where renormalization group methods can be applied. 
Far-from-equilibrium systems, often only described by 
dynamical rules, do not always lend themselves to the 
same methods of analysis, and as a consequence the un- 
derstanding of universality is less complete. Some sys- 
tems add another complication: they self-tune. We ask 
what happens to universality under conditions of self- 
tuning. In particular, we investigate in this paper a self- 
tuning mechanism that reproduces the universal finite 
size scaling of thermodynamic observables. While we in- 
vestigate these issues in a near-equilibrium system, the 
arguments we put forward may well be applicable to the 
far-from-equilibrium systems typically studied in the lit- 
erature on self-organized criticality (SOC). 

The term self-organized criticality has been used with 
many different meanings in different disciplines, often 
simply to describe a system whose internal dynamics lead 
to a degree of scale freedom in global observables. A more 
specific definition of SOC, which we employ here, is the 
spontaneous emergence of critical behavior in systems 
with continuous phase transitions. For instance, sand- 
pile models have been described in these terms [5H1]. 
In these systems, defined on cJ-dimensional lattices, lo- 
cal rules demand the toppling of particles to neighboring 
sites whenever a threshold value of the local particle den- 
sity is exceeded. The boundaries are open such that par- 
ticles can be dissipated, and a slow drive is implemented 
as an addition of a particle whenever the system reaches a 
globally stable state (no supercritical local particle den- 
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sities). In these systems the distribution of avalanche 
sizes, defined as the number of local reconfigurations in 
response to the addition of a particle, is scale-free. Mo- 
ments of the distribution show simple finite-size scaling 
[5], just like moments of the order-parameter distribution 
in equilibrium critical phenomena [6]. 

In 1988 Tang and Bak linked their sandpile model to 
ordinary non-equilibrium phase transitions [2] . The over- 
all particle density, was identified as the tuning pa- 
rameter and the density of active sites, p a , also called the 
"activity" , as the order parameter. Both are common ob- 
servables in continuous phase transitions, and their iden- 
tification enables the use of the powerful formalism of 
critical phenomena. Investigations of avalanche size dis- 
tributions, which are characteristic of the smaller body of 
literature on SOC, have been developed less extensively. 
We use a notation inspired by absorbing-state (AS) phase 
transitions 4] , for a review see [7] and references therein. 
Below a critical value, £ c , of the tuning parameter, the 
order parameter tends to zero since local thresholds are 
rarely surpassed anywhere in the system and hardly any 
topplings occur. The order parameter shows very good 
finite-size scaling, identical to that of corresponding AS 
phase transitions. In these corresponding models the 
boundaries are closed, and one measures quasi-stationary 
values of activities at fixed particle densities, ( [El E] ■ In 
other words, there is ample numerical evidence support- 
ing the fact that standard observables such as the or- 
der parameter in sandpile models respect the universal- 
ity classes of their corresponding phase transitions. This 
is also reflected in the observation that avalanche-size 
exponents are directly related to the scaling exponents 
describing the order parameter, correlation length, and 
survival time distribution in the corresponding AS sys- 
tems [TP] . 

Sandpiles are defined in terms of their microscopic dy- 
namics. It is desirable to mirror the effect of these dy- 
namics in a general scheme that can be applied to any 
continuous phase transition. One of the most natural 
such schemes is to have the order parameter feed back 
on the tuning parameter [3l [7]. Indeed, such coupling 
can force an approach to the critical point as the lin- 
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ear system size L diverges [TT], and in sandpile models 
a narrative of such a coupling seems natural: Driving 
the system increases the tuning parameter until the crit- 
ical point, (c, is reached and activity ensues. Activity 
then leads to diffusion-like motion of particles through 
the system and to dissipation at the boundaries, that is, 
a reduction of the tuning parameter to below its critical 
value. 

This general scheme can be summarized by the equa- 
tion of motion [4] 

d t C = h -ep a ((,t;L), (1) 

where h is a driving rate and e represents a coarse- 
grained, or bulk, dissipation. The activity, p a , depends 
on time t, and is treated as a noise term. The aver- 
age order parameter (p a ) — - is readily obtained from 
the stationary state of this equation. As long as (p a ) 
vanishes in the thermodynamic limit, L — > oo, critical- 
ity can be reached. However, the description of SOC 
as a result of a linear coupling between order and tun- 
ing parameter does not constrain the dynamics suffi- 
ciently to explain the identity of scaling behaviors. In 
this scheme (unlike in sandpile models), naive finite-size 
scaling analyses of thermodynamic observables do not 
show the universal scaling exponents. By "naive" we 
mean straight-forward numerical measurements of ob- 
servables like (p a ) (L), as performed in SOC sandpiles, 
without taking into account (or knowledge of) the scal- 
ing of the driving and dissipation, see below. To naively 
observe universal finite-size scaling without having to ac- 
count for the details of the tuning dynamics it would be 
necessary that (p a (L)) oc L^ 13 ^, where j3 and v are the 
exponents of the underlying phase transition. This can 
only be true if the system-size dependence of h and e 
(introduced by the facts that the density of dissipating 
boundary sites vanishes as L~ l and avalanche durations 
increase with L such that lim£_>. 00 h(L) = 0) is such that 
h(L)/e(L) oc L-P/". In the coarse-grained description 
of coupled order and tuning parameters there is no rea- 
son why this last condition should be fulfilled. Assuming 
power laws h(L) — h a L~ K and e(L) = e$L~ u : we ob- 
tain scaling but not with the universal exponents (assum- 
ing any functional form other than power laws produces 
no scaling at all). There is an undetermined parameter, 
k—uj, which must be chosen by design to force the univer- 
sal finite-size scaling exponents of the underlying phase 
transition upon the self-tuning system. Paradoxically, 
the scheme produces a system whose tuning parameter 
does assume its critical value in the thermodynamic limit, 
yet the exponents derived from naive finite-size scaling 
analyses are non-universal. This problem was described 
in detail in ref . [TT] , and further discussed in ref . [12l US] . 
Exponents estimated at criticality, e.g. from the spatial 
decay of correlation, or from critical scaling need not be 
affected by an arbitrary choice for k — uj. 

In the present study we explore a scheme that achieves 
two goals: The tuning parameter reaches the critical 
point in the thermodynamic limit, and the exponents de- 



rived from naive finite-size scaling analyses are identical 
to those of the underlying phase transition. Our goal is to 
understand the interplay between naively observed uni- 
versality and the dynamics of self-tuning in generic sys- 
tems. Here we choose a near-equilibrium system, but the 
findings may also be informative for far-from-equilibrium 
systems, like sandpile models. 

The problem with coupling the tuning parameter to 
the order parameter can be understood as follows. The 
system adjusts its tuning parameter according to Eq. 
to achieve, in the thermodynamic limit, the order pa- 
rameter zero. For finite systems, however, a non-zero 
value is targeted, which is arbitrary to the extent that 
h(L)/e(L), or equivalently n — w, is arbitrary. The finite 
value is necessary because at the level of description of 
Eq. (JlJ fluctuations in p a (t; L) ensure that (p a ) (L) is al- 
ways finite, even for £ = 0, for finite systems. Targeting 
zero (setting h/e = 0) would drive the system to zero 
tuning parameter and make SOC impossible. It may be 
argued that this constitutes a problem in the level of de- 
scription and that in sandpile models the value p a = is 
reached in finite systems since the absorbing phase (un- 
like the high-temperature phase in an Ising model) has 
no fluctuations. Typically, however, the order parameter 
p a , is defined as the asymptotic (long time average) value 
of the density of active sites, conditioned on the existence 
of active sites, see e.g. [5]. It is therefore always non-zero. 
In other words a "complete description" would require a 
rc-dcfinition of p a and a revision of the entire formalism 
developed so far. Our approach is independent of the 
presence of fluctuations in the phase of vanishing order 
parameter. 

Tuning the order parameter to zero as L diverges leaves 
an undesired arbitrariness in the intermediate values. In- 
stead, we use the most prominent signals of criticality, 
i.e. the critical singularities (e.g. susceptibility, heat ca- 
pacity, correlation length). The advantage of coupling 
the tuning parameter to such a singularity is that naive 
finite-size scaling is universal, as numerical evidence sug- 
gests to be the case in SOC. This will be shown below. 

For example we could couple the temperature T of a 
magnetic system to the susceptibility, x(T; L) which di- 
verges uniquely at the critical point, x(T] L — > oo) oc 
\T — > Tel -7 . This could be described by an equation of 
motion for the temperature 

d t T = kd TX (T,t;L), (2) 

where k is a constant that is related to the relaxation 
time and needs to vanish in the thermodynamic limit 
to prevent destabilization. Under sufficiently slow dy- 
namics, the stationary temperature of Eq. ^ will be 
that of maximum susceptibility, where &rx(T] L) = 0. 
As is well known, the position in T of the peak of the 
susceptibility, T Xmax (L), approaches the critical point as 
|T Xmax (L) - T c \ oc L^ 1 /" . A derivation of this result from 
scaling arguments based on the renormalization group 
can be found in ref. [T3], p. 72. The prefactor deter- 
mining the shift in T' Xmax (L) for finite L depends on the 
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boundary conditions of the system, but for our argument 
only the scaling behavior is important. If the system is 
well characterized by the average temperature it assumes 
under these dynamics, (T), it will be equivalent to a sys- 
tem approaching T c with the exponent needed to naively 
observe the universal scaling behaviour, i.e. that of a 
system fixed at temperature T = T c , while L diverges. 
In Monte Carlo studies of systems with unknown critical 
tuning parameter values, e.g. ref. [15] . similar arguments 
ensure that scaling exponents can be derived numerically. 

With T(L) - T c oc L -1 /", we find (|m|) (T(L)) cx 
(T(L) — T C )P oc L^ 13 /", which is the universal scaling 
behavior. The same argument holds for all other thermo- 
dynamic observables, and equivalent results are obtained 
if we couple to any other quantity that diverges uniquely 
at T c . Thus, by coupling the tuning parameter to the 
susceptibility the naive finite-size scaling becomes fully 
universal. 

The above ideas are implemented by modifying a 2-d 
Ising model and allowing it to adjust its dimensionless 
coupling constant, K = J/(ksT), where J is a ferromag- 
netic Ising coupling, and kg is Boltzmann's constant. 
Physically, this corresponds to adjusting the tempera- 
ture. We want to design a system that finds the maxi- 
mum of the susceptibility with a precision that only de- 
pends on one scale, which may be linked to the system 
size. Instead of measuring the first derivative 8tX re ~ 
quired in Eq. ^ we choose the more robust method of 
bracketing to approach the maximum, see e.g. ref.|16j. 
Chapter 9. To this end, three systems of equal size and 
shape but different initial temperatures K\ < K 2 < K 3 
are run simultaneously for i max Monte Carlo steps. The 
first half of this time is used for equilibration; in the 
second half the first and second moments of the magne- 
tization are recorded, and from them the susceptibilities 
x{Ki) are calculated. 

Ordering the temperatures by the corresponding sus- 
ceptibilities, there are now 3! = 6 possible scenarios. 
These can be grouped into two cases: 

If the ordering of temperatures indicates that the max- 
imum has not been bracketed, i.e. if Xmax > K 3 or 
K Xinax < K\, then the search range is widened by re- 
assigning the temperature furthest away from T Xmax . 
For example, if K Xtaajc > K 3 , then K\ is shifted to 
K[ = K 3 y / K 2 K 3 / K\. Other choices are possible, e.g. 
(K 3 ) 2 /Ki; the only requirements are that the reassign- 
ment do not introduce any special scales (as would be the 
case e.g. for the choice K 3 + AK with a fixed AK) and 
that it widen the search range. The choice made here is 
convenient for its numerical stability. 

If the maximum appears to be bracketed, i.e. K\ < 
if Xmax < K 3 , the search range is narrowed by halving the 
distance in log-space between the middle-temperature 
and the temperature furthest away from it. For example, 
if K 3 is to be reassigned, it is shifted to K' 3 — \JK 2 K 3 

Iterating this method the system (consisting of three 
Ising models) will shrink its search range until the accu- 
racy with which \ is estimated during t max Monte Carlo 
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FIG. 1: Self-organizing couplings in a system of size L — 64. 
Each time step consists of an equilibration of 388 scans over 
the lattice and another 388 scans during which the suscepti- 
bility is determined. At t = 1191, the maximum is not brack- 
eted and the search range is widened. In the next time step 
it is bracketed, and the range shrinks. Initially three tem- 
peratures far from criticality (K c « 0.44068) are chosen that 
bracket the maximum, K\ = 0.3, -fG = 0.5,7^3 = 0.6. The 
systems converge near the temperature of maximum suscep- 
tibility. Statistics are collected after 1000 equilibration time 
steps. 

steps forces it to widen the search range. Due to fluc- 
tuations and the finiteness of t max , the measured xi^i) 
remain stochastic variables, and the three temperatures 
will fluctuate around the true T Xmax for any given sys- 
tem size as exemplified in Fig. [l] Importantly, however, 
the range of these fluctuations can be made arbitrarily 
small by increasing t max , see Fig. [2] As L increases, the 
most likely and average temperatures approach T c , while 
the distributions become narrower. Holding £ max fixed, 
one observes the expected finite-size scaling of the tem- 
perature, i.e. I (T) — T c \ oc L~ x l v and all other ther- 
modynamic observables, e.g. (|r7i|) cx L - * 3 /", up to a 
certain system size where the accuracy with which T Xmax 
is estimated becomes insufficient. Eventually the system 
becomes unstable as the assumption £ max equilibra- 
tion time becomes invalid. In order for naive finite size 
scaling to be universal without a bound on L, we require 
that i max increase sufficiently fast. The exact minimum 
speed at which i max must diverge with L depends on the 
chosen dynamics and is given by the dynamical exponent 
z. We require 

'max 

ocL x , (3) 

where x > z. This was only superficially confirmed by 
estimating the maximum equilibration times that desta- 
bilized systems of different sizes. In Fig. [3] numerical 
results of the most prominent observables are presented 
for system sizes up to L = 512, where x = 2.15 was used. 
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FIG. 2: The distribution of self-organized temperatures, can 
be made arbitrarily narrow by increasing i max , see main 
graph, where £ max = 0.4 x 32 2 15 ,0.4 x 64 2 15 ,0.4 x 128 2 15 , 
for fixed L = 32. Inset: Temperature distributions for 
L = 16, 32, 64, where K is adjusted after a fixed t max = 
0.1 x 128 2 15 . 
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FIG. 3: The average self-organized temperature (triangles), 
magnetization (squares), and susceptibility (circles) in sys- 
tems ranging from L = 4,8, 16. ..512. Straight lines represent 
power laws with the known exponents of the 2-d Ising univer- 
sality class, symbols are measurements. 



For the single-spin flip dynamics used here, z = 2.13(3) 
|17j . Stricly speaking, the macroscopic time referred to 
in Fig. [T]to estimate the position of the peak of the tem- 
perature distribution also has to increase with L. In the 
present study we are always far from the limit where this 
issue becomes important. Our situation is fundamen- 
tally different from that of the order parameter coupled 
to the tuning parameter, where there was only one spe- 
cial choice for the exponent k — co that reproduced the 
known finite-size scaling exponents. The new scheme is 
more robust since the exponent x > z is only restricted 
to a semi-infinite range. This situation is very similar 



to sandpiles in the following sense: For a sandpile to 
display proper scaling for all system sizes, the intervals 
(measured in a microscopic time scale of individual top- 
plings) between additions of grains must diverge with 
system size fast enough. However, it is impossible to 
drive a sandpile "too slowly" . If the drive is slower than 
necessary, then the sandpile will be inactive for a while 
between avalanches, but the avalanches and associated 
order-parameter properties will still obey the universal 
scaling laws. 

The idea for the present study emerged from a discus- 
sion of biological evolutionary systems that are believed 
to maximize a form of susceptibility, as they balance the 
need for rigidity to store information (for example in the 
form of DNA) against the need for flexibility to respond 
to new situations. While the use of multiple copies of a 
system may seem curious in the context of sandpiles, it 
is unavoidable in the context of evolution. 

The correlation length, £, which also diverges at criti- 
cality, seems the most natural means to discuss the rele- 
vance of the proposed mechanism to sandpile models. It 
has been speculated that the correlation length plays an 
important role in the feedback between order- and tuning 
parameter [3j. The correlation length measures the spa- 
tial distance over which perturbations to a system can be 
communicated. In thermal systems £ needs to be inferred 
from the spatial decay of correlation functions. In sand- 
piles, on the other hand, the length over which pertur- 
bations are communicated is dictated directly by the dy- 
namics. Any particle added to a sandpile must be trans- 
ported to the boundaries to be dissipated. The assump- 
tion of stationarity thus implies that perturbations can 
be felt across the entire system, i.e. £ oc L. Clearly, this 
corresponds to the maximization of £ for any L. Impos- 
ing this relation, just like maximizing the susceptibility, 
leads to the preservation of naively observed universality, 
see also [TT]. Therefore, thinking of sandpile models as 
correlation-maximizers rather than activity-minimizers, 
observations of the universal scaling exponents become 
the expectation rather than the surprise. 

In conclusion, a mechanism has been investigated 
which does more than bring a system to the critical 
point. It reproduces the scaling exponents observed in 
finite-size scaling studies where a corresponding model is 
fixed at criticality. Thus the mechanism preserves uni- 
versality in naively performed finite-size scaling analyses 
under conditions of self-tuning. This was achieved by 
letting the tuning parameter maximize a quantity that 
diverges uniquely at criticality. In contrast to a coupling 
between order and tuning parameter, this allows us to 
use the well-defined maximum rather than an arbitrary 
small parameter for orientation. The Ising model was 
used to show that the process is indeed capable of re- 
covering both the well-known scaling exponents and the 
critical temperature. 
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